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(57) Abstract: A procedure for displaying Diffraction Specific (DS) Computer Generated Holograms (CGH) includes the provision 
of a novel diffraction table (DT) modified so as to store a complete decoded fringe for each point capable of being projected into the 
image volume. When generating a DS CGH the diffraction table is produced that holds data relating to the image to be projected. 
The prior art stores in this diffraction table a set of hogel vectors that are used to select a set of basis fringes relating to each point to 
be displayed on the CGH. This means that each basis fringe corresponding to a particular hogel vector must be accumulated together 
with all the others before a complete fringe is produced. The pre-computation of the fringes as per the current invention singificantly 
reduces the online processing requirements of producing an image, as the new DT can be produced offline with no knowledge of the 
image to be displayed. 
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3D display 

This invention relates to improvements to three-dimensional (3D) displays, 
and their associated image generation means. More specifically, it relates to 
5 a display system and method having a reduced computation time and power 
needed when generating image data using a diffraction specific computer 
generated holographic (CGH) algorithm. 

Introduction 

1 0 Holographic displays can be seen as being potentially the best means of 
generating a realistic 3D image, as they provide depth cues not available in 
ordinary two dimensional displays or many other types of 3D display. The 
accommodation depth cue, for example, is a cue that the brain receives when 
a viewer's eye focuses at different distances and is important up to about 3 

1 5 meters in distance. This is, of course a cue that is used when looking at real 
objects, but of the 3D display technologies currently available, only true 
holograms provide 3D images upon which the eye can use its accommodation 
ability. It is a desire to be able to produce reconfigurable holographic displays 
electronically, such that an image can be generated from computer held data. 

20 This gives flexibility to produce holographic images of existing objects or non- 
existent objects without needing to go through the time consuming and 
expensive steps normally associated with their production. 

Unfortunately, producing such an image electronically is extremely 
25 challenging. Methods exist, however, for just such generation, but they 
currently require a large amount of computing time, and specialised display 
hardware. 

One such method of computing a CGH is to use what is known as the 
30 Diffraction Specific (DS) algorithm. A DS CGH is a true CGH (as opposed to 
a holographic stereogram variant) but has a lower computational load than 
Interference Based true CGH algorithms. The reason for this is that the DS 
algorithm is currently the most effective in terms of controlling the information 
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content of CGH and avoiding unnecessary image resolution detail that cannot 
be seen by the human eye. 

A key concept of the DS algorithm is the quantisation of the CGH in both 
5 spatial and spectral domains. This allows control of the amount of data, or the 
information content of the CGH, which in turn reduces the computational load. 
The CGH is divided up into a plurality of areas, known as hogels, and each 
hogel has a plurality of pixels contained within it. The frequency spectrum of 
each hogel is quantised such that a hogel has a plurality of frequency 
1 0 elements known as hogel vector elements. 

The CGHs themselves are displayed on a panel capable of being 
programmed to diffract light in controlled manner. This panel is usually a 
spatial light modulator. Note that the term "diffraction panel" is used to 
1 5 describe this panel in this specification before diffraction information is written 
to it, although once the diffraction panel is written with diffraction information, it 
can be interchangeably termed a CGH. 

The 3D-image volume is made up by the diffraction of light from the complete 
20 set of hogels. The diffraction process sends light from one of the hogels in a 
number of discrete directions, according to which hogel vector elements are 
selected, as described below. 

A given image must have the correct hogel vector elements selected in the 
25 appropriate hogels in order to display properly the image components. A 

diffraction table allows this selection to be done correctly. The diffraction table 
maps locations in the image volume to a given hogel, and to the required 
hogel vector elements of that hogel. These locations, or nodes, are selected 
according to the required resolution of the 3D image. More nodes will give a 
30 better resolution, but will require more computing power to generate the 
display. Having control of the nodes therefore allows image quality to be 
traded for reduced processing time. In the prior art the hogel vector selects 
which basis fringes are required by a given hogel in order to construct the 3D- 
image information. 
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The selection of the required diffraction table entries is compuied from data 
based on the 3D image or scene to be displayed. A geometric representation 
of the image is stored in the computer system. The geometric information is 
5 rendered using standard computer graphics techniques in which the depth 
map is also stored. The rendering frustum is calculated from the optical 
parameters of the CGH replay system. The rendered image and the depth 
map are used to define, in three dimensions, what parts of the whole 3D 
image will be visible to a particular hogel. These parts define which diffraction 
10 table entries should be used to compute the hogel vector. 

Finally, to produce the full CGH, the hogel vectors are decoded using basis 
fringes. A basis fringe has the same spatial extent as the hogel it is 
associated with and has a finite frequency content centred on a given hogel 

15 vector element. Basis fringes are pre-computed and are object geometry 
independent. Their computation is based on a complex set of constraints 
such that the weighted linear accumulation of the entire set of basis .fringes 
(one for each hogel vector element) results in a complete hogel with a pseudo 
continuous spectrum. This process is repeated for each hogel that comprises 

20 the CGH. 

More details of this procedure can be found in refs. 1 , 2 and 3. 

There are problems with this method however. The processing effort required 
25 in carrying out the above steps is too great for all but small images to be 
produced. Even though the DS algorithm is the most efficient one used for 
generation of a CGH, it still takes a significant amount of time on a high end 
computer system to do the processing required for each image. 

30 Statement of invention 

According to the present invention there is provided a computer generated 
hologram display system comprising at least a light diffraction plane notionally 
divided into a plurality of hogels, an image volume space and image 
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calculation means, wherein the image calculation means incorporates a 
diffraction table that stores, for each hogel, fringe information that can be 
written to the hogel that directly reconstructs a wavefront to be projected 
towards the image volume space to create an image point. 

5 . 

Thus where the prior art stored in the diffraction table a set of hogel vector 
elements that require decoding with basis fringes before being written to the 
light diffraction plane, the current invention stores in the diffraction table a fully 
decoded fringe that can be directly written to the diffraction plane. This results 
10 in much faster generation of the hologram, as the decoding process of the 
prior art needs to be done on-line, i.e. has to be done for each different object 
geometry during the actual CGH calculation. 

The current invention generates the diffraction table offline, and no knowledge 
15 of the object to be displayed is needed in its generation. 

The invention removes the need for basis fringes altogether, as the diffraction 
table now stores the fully decoded hogel fringes in the form in which they are 
written to the light diffracting panel. Note that in this specification, a fully 
20 decoded fringe is known as a hogel fringe. 

The step of decoding the hogel vector is no longer necessary with the current 
invention. The prior art required the hogel vectors to be multiplied by the pre- 
computed basis fringes to generate the final hologram data. The current 
25 invention provides for the decoding process to be replaced with a look-up 

stage that merely takes the appropriate parts of the diffraction table containing 
the hogel fringe data for each hogel. 

This look-up stage requires knowledge of the geometry data for whatever 
30 object is desired to be displayed. Optical replay geometry is used to calculate 
a series of frustums in 3D space for each hogel. Rendering of the frustums 
provides 2D images with depth information, and is used to calculate which 
image volume points a given hogel must create. The hogel fringes stored in 
the DTthat correspond to those points that are so required are used to 
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populate the hogel. This is done by accumulating the diffraction table entries 
for each image volume point into the final accumulated hogel fringe. 

In effect, during the offline part of the processing, the image volume is 
5 sampled in space at some suitable resolution, taking into account the 
limitations of the resolution of the human eye and the requirements of the 
application to which the display is to be put. Thus the diffraction table of the 
current invention stores information on every point in the image volume, not 
just the ones that make up the image to be displayed. When it is required for 
1 0 the system to display a given object, the image details of the object are used, 
as described above, to look up the hogel fringe information relating to each 
point on the object surface. 

According to another aspect of the invention there is provided a method for 
1 5 displaying a computer generated hologram display system comprising at least 

a light diffraction plane notionally divided into a plurality of hogels, an image 
..volume space and image calculation means, wherein the method comprises 

the steps of incorporating a diffraction table with the image calculation means 

and storing in the diffraction table pre-calculated fringe information for each 
20 hogel, and writing the fringe information to each hogel that directly 

reconstructs a wavefront to be projected towards the image volume space to 

create an image point. 

The current invention may be implemented on any suitable computer system. 
25 In particular, this computer system may be integrated into a single computer, 
or may contain distributed elements that are connected together using a 
network. 

The method of the current invention may be implemented as a computer 
30 program running on a computer system. The program may be stored on a 
carrier, such as a hard disk system, floppy disk system, or other suitable 
carrier. The computer system may be integrated into a single computer, or 
may contain distributed elements that are connected together across a 
network. 
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Detailed Description and Drawings 

5 The current invention will now be described in detail, by way of example only, 
with referenced the following diagrams, in which 

Figure 1 illustrates in diagrammatic form the geometry of the CGH replay 
optics. 

10 

Figure 2 illustrates in diagrammatic form a CGH showing the division of the 
area into hogels. 

Figure 3 illustrates in diagrammatic form a typical hogel vector. 

15 

Figure 4 illustrates in diagrammatic form the hogel vector decoding process of 
ttie.piiox.art. 

Figure 5 illustrates in block diagrammatic form a logical. breakdown of the 
20 steps required to compute a Diffraction Specific CGH as used in the prior art. 

Figure 6 illustrates in block diagrammatic form the reduced steps of the 
current invention 

25 Figure 7 illustrates in diagrammatic form the setup of the replay optics of the 
current invention, and shows for a single hogel the frustum that is rendered. 

Figure 1 illustrates the replay optics of a general CGH system, including a 
30 system capable of implementing the current invention. The diffraction panel 1 
is shown transmitting a set of plane waves 7, encompassed by a diffraction 
cone 5 through a Fourier lens 3, where the waves 7 get refracted towards an 
image volume 2. It can be seen that the extent of diffraction of the plane 
waves, given by the cone 5 defines the size of the image volume 2. As the 
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diffracted waves 7 radiate symmetrically from the diffraction panel 1 , a 
conjugate image volume 6 is also formed adjacent the image volume 2. 
Figure 1 only shows plane waves 7 radiating from one area of the panel 1 , but 
of course in practice, each hogel on the panel 1 will be radiating such waves. 
5 If the diffraction panel 1 is written correctly with appropriate fringe data for a 
given hologram, a viewer in the viewing zone 4 will see a true 3D image in the 
image volume 2, and the image conjugate in the volume 6. In practice, the 
conjugate image 6 is usually masked out. 

1 0 The distance of separation between the Fourier lens 3 and the diffraction 
panel 1 is kept as short as possible to simplify the processing. The steps 
involved in calculating the hogel vector components as shown below assume 
that this distance is zero. 

1 5 Figure 2 shows the spatial quantisation of the diffraction panel 1 into a 2D 
array of hogels. Each hogel (for example 8) is shown having a plurality of 
..pixels, jatwo.dimensipns. Therefore, a diffraction panel 1 so divided would be 
suitable for implementing a full parallax (FP) system. The number of pixels 
shown present in each of the hogels (for example 8) is shown figuratively only. 
20 In practice there would be approximately 2000 to 4000 pixels in each hogel 
. dimension. In a Horizontal Parallax Only (HPO) system, each hogel would 
have only one pixel in the vertical dimension, but approximately 2000 to 4000 
in the horizontal dimension. 

25 The current implementation is restricted to a HPO system, to ease computing 
requirements. A HPO system is calculated to provide a fringe pattern that 
diffracts only in a single dimension - usually the horizontal dimension. This 
allows reduced pixel counts, which are hence faster to calculate. Anamorphic 
optics can also be used in the replay of such a hologram. 

30 

Figure 3 shows the spectral elements 9 of a typical hogel vector that is stored 
for each hogel. A diffraction table of the prior art holds such a hogel vector for 
each hogel in the system. This is the method of the prior art. Each 
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component of the vector represents a spatial frequency present in the final 
decoded fringe to be written to the hogel in question. 

Figure 4 shows how the prior art converts the hogel vector, of Figure 3 into a 
5 form having a continuous spectrum 1 0. This is the spectrum of the final 
decoded fringe that is written to the light diffracting panel 1 . Each element of 
the vector, similar to that shown in Figure 3, is multiplied with a basis fringe 1 1 
pre-computed for that spectral element, to produce a smooth output spectrum 
as shown on the right in Figure 4. This all takes a significant amount of 
10 processing, resulting in the need for either more computing power, or longer 
image processing times. 

Figure 5 shows the stages of computation necessary in the prior art to 
produce fringe data for a DS CGH. Data relating to the object to be displayed, 

1 5 as well as other input parameters such as the required resolution, hogel 
parameters, wavelength of light and optical replay system parameters are 
jnputs.to.tbe code.' The diffractjpn. table .generator holds a pre-computed set 
of hogel vector elements relating the hogels to points in image volume space. 
Appropriate hogel vector elements are selected by the hogel vector calculator, 

20 " according to which points are required to make up the complete object. 
These points are given by the 3D geometry as discussed elsewhere in this 
specification. The hogel vectors that are chosen by the hogel vector 
calculator are then input to the hogel vector decoder, which generates a 
decoded fringe spectrum by selecting and accumulating the appropriate basis 

25 fringes for each hogel vector element. The resulting decoded fringe forms a 
part of the final CGH and is displayed on the diffraction panel. 

Figure 6 show the stages of computation necessary with the current invention 
The input information is similar as before, but there are fewer stages of 
30 computation necessary to produce the CGH fringes. The current invention 
has a diffraction table that holds, instead of hogel vector elements in the form 
of the prior art, complete, decoded hogel fringes. These are selected by the 
hogel calculator according to which points are required for a given hogel, in 
order for that hogel to construct points in the image volume that are visible to 
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a viewer observing the CGH at an angle for which diffracted light from the 
hogel enters the observer's eye. The result of this is a fully decoded hogel 
fringe that is ready to be written to the appropriate hogel location on the 
diffraction panel. 

5 

Note that the wavelength of the light used to read the resultant hologram is a 
parameter to be considered when calculating the decoded hogel fringes that 
are stored in the diffraction table. Although current embodiments are based 
on only a single wavelength being used, that wavelength may be anything 

1 0 suitable for a given application. Off-line precalculation of the diffraction table 
is all that is necessary if the wavelength needs to be changed. The diffraction 
table can be enlarged to include decoded hogel fringes that are calculated for 
more than one wavelength simultaneously. In this way, the system is able to 
quickly change between different readout wavelengths, or to create holograms 

1 5 for multiple wavelength readout. 

.Figure 7 shows how the geometry gives rise to a frustum 12 for each hogel. 
The rendered frustum 12 then results in a 2D image of the 3D object as seen 
from the particular hogel in question, along with information recording the 
20 depth of each point in the frustum. This work is done by the hogel calculator 
shown in Figure 6, using a routine known as the Multiple Point Renderer. 

The hogel fringes stored in the diffraction table of the current invention are 
calculated as follows. 

25 

For a given optical geometry and CGH the allowable image volume is 
sampled in space such that resolution of the sampled points is above the 
resolution for typical viewing distance. These points are used to construct a 
Diffraction Table (DT) and the points are referred to as Diffraction Table 
30 Points (DTP'S). The wavefront of a DTP at a hogel is given, for an idealised 
situation, by equation (1 ), z = 0 is assumed, see [2]. 

a(x) = ^«pEH«pkf - V* 2 +/ 2 )l < 1 > 
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where r = ^{x-x^f +(z-z p f 
a p is the point amplitude 
x p ,z p is position of point p 
however in general the wavefront will be more complex, and would be 
5 determined in practice by, for example, Optical Ray Tracing 

We then optionally sample the wavefront through the replay optical 
components at each hogel pixel position, or compute the hogel vector before 
• then decoding it in advance. This can be done in a number of ways. The most 
1 0 computationally efficient method is to Fourier transform the real component of 
the calculated wavefront. As long as the developer is careful to avoid 
sampling artefacts sometimes associated with Fourier transforms this can give 
directly the hogel vector. 

1 5 Alternative strategies can also be applied. These include using Fourier series 
.for-each -hogel vector component, m,.aDd numerically integrating the Fourier 
component over the hogel extent: 



20 



hv m = J exp 



— Im27ix 



{x,z)dx (2) 



25 



|_ period _ 

where xmin and xmax define the hogel boundaries. 

So Jexp[-^^]^exp[?4W + /--\/^ 2 +/ 2 )]^ (3) 

Where ^ = -^t (4) 
period 

LBt^x)=k(r(x) + f~4x 1 Tf T ) (5) 
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-L [cos(/?(x)) + i sin(£ (*))]& (7) 

We are only interested in the real part of this expression because the CGH is 
5 typically an amplitude modulator. The real part of the integral then becomes: 

a f * [cos(^)cos(£(*))+ sm(<ax)sm(/?M)]<fc (8 ) 

This integral can be evaluated using Simpson's Rule. 

Alternatively, a more computationally efficient method is to evaluate the 
1 0 integral using a FFT technique. In this case then we need an integral of the 
form: 

Jexpfz'6) xtyfytix or equivatently- 

ai = \cos{m)h{x)dx 
4n*g = \sm{GJx)h{x)dx 

And so we re-arrange (8) to give: 
a jcos(cDx)h(x)dx 



f \ 1 r t \\ sin(aa)sin(/?(x)) 
15 whereAW^ «*(/?(*))+ ) 



(cox) 



(9) 



Another FFT based technique involves re-arranging (7) to form FFT pairs that 
can be evaluated and the results re-arranged appropriately. This is shown 
below. Equation (7) can be re-arranged as: 
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a f * cos(<ac)cos(^^^ 
J r(x) J r{x) 

aj f-LcosWsin(/?(x))ix-o/ f^sin(^)cos(£(x)>Zx 
J r(x) ' J r[x) 

(10) 

These 4 integrals can be arranged into 2 FFT pairs. The result of a FFT 
integral is a real and imaginary part that can be used independently. So we 
5 write: 

a \*cos{cox)cos{j3(x))dx - al f-fr sin (a*)cos(£ (x))dx + 
J r(x) J r{x) 

a \-^sm{(ax)sm(B(x))d^ 
h(x) J r{x) 

(11) 

Jexp(ficc>(^ where h(x) = a-^cos(/?(x)) 

1 (11a.11b) 
Jexp(fircM^>ic where 'A(x) = a^sm(^(*)j 

The final result can be achieved by firstly negating the sin part of (11a), and 
1 0 secondly adding the real part and imaginary part of (1 1 a) and (1 1 b) together 
in order to give the final result of (7). In practice, we need only evaluate the 
real components. This technique has been shown to agree perfectly with 
Simpson's Rule on the real and imaginary parts of (7) as shown in (8). 

1 5 The result of these differing techniques is a hogel vector (HV). The information 
content and quality of the resultant point in image volume space may be 
manipulated by reducing the number of HV elements. The minimum number 
of HV elements required to adequately sample the DTP can be estimated by 
finding the maximum rate of change of the wavefront over the hogel. Using 

20 this value, any additional HV elements can be neglected. 

The hogel vector can be decoded by an inverse Fourier transform. 
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This is the most direct and computationally efficient method. An alternatively 
strategy is to use basis fringes in the decoding step. This can still be done as 
an off-line calculation, and may have advantages in image quality 
manipulationand control. 

The present invention has been implemented in software using the following 
basic routine, shown here in top level in pseudo code: 



For each line of the hologram: 
1 o For each hogel along the line: 

Reset hogel fringe buffer to zeros 

Open the appropriate Multiple Viewpoint Renderer intensity and 

depth files 

For each hogel lateral resolution position: 
1 5 Read corresponding Multiple Viewpoint Renderer image 

pixel depth 

Find corresponding DTP with nearest depth to image 

depth 

Read corresponding Multiple Viewpoint Renderer image 
20 pixel intensity 

For each DTP pixel: 

Read pixel amplitude. 

Multiply DTP pixel amplitude by rendered image 

pixel intensity 

25 Accumulate result into hogel fringe buffer. 

Next DTP pixel 
Next hogel lateral position . 
Output hogel fringe 
Next Hogel 
30 Next hologram line 
Output hologram 
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The current invention has been implemented on an Active-Tiling® Computer 
Generated Hologram display system. The computer system used to produce 
the CGH can be a standalone unit, or could have remote elements connected 
by a network. 

5 

. The Active Tiling system is a means of producing holographic moving images 
by rapidly replaying different frames of a holographic animation. The Active 
. Tiling system essentially comprises a system for directing light from a light 
source onto a first spatial light modulator (SLM) means and relaying a number 
10 of SLM subframes of the modulated light from the first high speed SLM means 
onto a second spatially complex SLM. The CGH is projected from this second 
SLM. 

The full CGH pattern is split up into subframes in which the number of pixels is 
1 5 equal to the complexity of the first SLM. These frames are displayed time- 
sequentially on the first SLM and each frame is projected to a different part of 
the second SLM. The full image is thus built up on the second SLM overtime. 
The first SLM means comprises an array of the first SLMs that each tile 
individual subframes on the second SLM over their respective areas. 

20 

Light from an SLM in the array must not stray onto parts of the second SLM 
not intended for it. To prevent this a shutter can be placed between the first 
SLM means and the second SLM, which masks off those areas of the second 
SLM that are not currently being written to. Alternatively, electrodes on the 

25 second SLM that cover the area where it is not wished to write an image can 
simply be not provided with a drive voltage. Thus any light that is falling onto 
the second SLM in these areas has no effect on the modulation layer. This 
avoids the need for a shutter system. The first SLM of such a system is of a 
type in which the modulation pattern can be changed quickly, compared to 

30 that of the second SLM. Thus its updating frame rate is greater than the read- 
out frame rate of the second SLM . 

i 

The Active Tiling system has the benefit that the image produced at the 
second SLM, which is addressed at a rate much slower than that of the first 
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SLM array, is effectively governed by the operation of the first SLM. This 
permits a trade off between the temporal information available in the high 
frame rate SLMs used in the SLM array and the high spatial resolution that 
can be achieved using current optically addressed SLMs as the second SLM. 
In this way, a high spatial resolution image can be rapidly written to an SLM 
using a sequence of lower resolution images. 

See PCT/GB98/03097 for a full explanation of the Active Tiling system. • 
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Claims 

1 . A computer generated hologram display system comprising at least a 
light diffraction plane notionally divided into a plurality of hogels, an image 

5 volume space and image calculation means, wherein the image calculation 
means incorporates a diffraction table that stores, for each hogel, fringe 
information that can be written to the hogel that directly reconstructs a 
wavefront to be projected towards the image volume space to create an 
image point. 

10 

2. A computer generated hologram display system as claimed in claim 1 , 
wherein the fringes stored in the diffraction table are computed before any 

**^tement of the image has been displayed. 

15 3. A computer generated hologram display system as claimed in claim 1 
or claim 2 wherein a hogel vector associated with a particular hogel is 
.calculated by Fourier transforming the real component of a calculated 
wavefront projected from a point to be displayed to the hogel. 

20 4. A computer generated hologram display system as claimed in claim 3 
wherein a hogel fringe to be written to the hogel is produced by transforming 
the hogel vector to the spatial domain. 

5. A computer generated hologram display system as claimed in any of 
♦ 25 the above claims wherein the image calculation means is arranged to 

calculate a plurality of image points that together make up an image having 
full parallax 

6. A computer generated hologram display system as claimed in claims 1 
30 to 4 wherein the image calculation means is arranged to calculate a plurality 

of image points that together make up an image having horizontal parallax 
only 
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7. A method for displaying a computer generated hologram display 
system comprising at least a light diffraction plane notionally divided into a 
plurality of hogels, an image volume space and image calculation means, 
wherein the method comprises the steps of incorporating a diffraction table 
5 with the image calculation means and storing in the diffraction table pre- 
calculated fringe information for each hogel, and writing the fringe information 
to each hogel that directly reconstructs a wavefront to be projected towards 
the image volume space to create an image point. 

10 8. A method as claimed in claim 7 wherein the image calculation means 
looks up the appropriate diffraction table entry for a given hogel based on 
information derived from the geometry of an object to be displayed . 

9. A computer generated hologram display system as claimed in claim 1 
15 wherein the display system comprises: 

a. light source, 

a first spatial light modulator means having an associated updating frame rate, 
20 that modulates light from the light source, 

relay optics means in the path of the light from the first spatial light modulator 
means for guiding the modulated light therefrom, 

25 a second spatial light modulator having an associated read-out frame rate in 
the path of the guided light from the relay optics means and arranged to 
produce a real image therefrom for display, 

wherein the updating rate of the first spatial light modulator means is greater 
30 than the read-out frame rate of the second spatial light modulator means. 

10. A computer program capable of representing a three dimensional 
object using the method as claimed in claim 7 or claim 8. 
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11. A carrier including a computer program as claimed in claim 10. 

1 2. A computer generated hologram display system substantially as 
described herein with reference to Figures 6 and 7. 

13. A method for displaying a computer generated hologram substantially 
as described herein with reference to Figures 6 and 7. 
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